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ABSTRACT 

- Mathematical word problems are notoriously difficult 
to solve for students at all grade levels. Performance deficiencies 
have been attributed to students lacking abstract ipgico-mathem^ical 
knowledge or to insufficiently developed language comprehension 
skills. At J.east four general sources of difficulty can be 
distinguished in mathematical .wor'^ problems: (1) the verbal 
formulation of the problem text; (2) the stru-'-ture of the underlying 
episodic problem situation; (3) the conceptual logico-mathematical or 
arithmetical kK->wledge about set relations; and (4) the arithmetic 
problem solving skills that are required to perform counting 
operairions or to resolve -equations. This paper descr^ibes a process 
model Situation-Proble'iD-Solver (SPS) computer program that constructs 
a problem representation based on strategies that take into account 
the specific situational structure as well as its wording. Discussed 
in this -study is the role of ,two linguistic and of one situational 
factors on comprehension difficulty of simple mathematicaL word 
problems. The linguistic, form factors that were manipulated concerned 
the narrative focus of the problem episode and the problem question. 
The results of this experiment indicate the script factor to be a 
dominant source of comprehension difficulty. (KR) 
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textual and situational factors in solving 
matheinatica! word problems , ^ 2 

Kurt Rcusser, University of Berne. 



Mathematical word problems are notoriously difficult to solve for students at all 
grade levels. What makes word problems more difficult than comparable problenis pn;- 
sented in a numeric format? The basic assumption that guided our theorizing in the.past 
few years is that explanations of solving mathematical word or situation pibbbms and ^ 
its development roughly fall in two categories ^(Qmimins-Dellarosa, Kint^chi Reiisser 
& Weimer 1988): Kther performance deficiencies are attributed to lacldng.abstract 
logico-niathematical knowledge, or to insufficiently developed;languagc comprehen- 
sion skills. At least four general sources of difficulty can be distinguished in mathema- 
tical word problems: (a) the verbal formulation of die problem text, (b) the structure of 
the underlying, episodic problem situation, (c) the conceptuahlogico-mal^em or 
arithmetical knowledge about set relations, and (d) the arithmetic proWem solving 
sldils that are required to perform counting operations or to resolve equations.^ 



" Conceptual versus linguistic factors in word prob: jns . 

Recent research on simple word problem^ including several computer simulation- 
models (Riley, Greeno & Heller 19?Si,Briars &Larkina^84; Kintsch &^G^ 1985), 
has focused mainly on the conceptual structure, i.e. pn the abstract logico^mathematical 
knowledge underlying the solving of word problems (Cummins, Kintsch, Rcusser & 
Weiiner 1988}. Correspondingly, many enjpirical studiejs. have revealed, for; different 
age^ levels, die impohance contribution of the abstract conciepnial i)rcblem type 
(change, combine, compare), together with the ibcation of the unknown^'quantity, to 



1 Paper preseriie^i at the AERA Annual Meeting, Boston, April 16-20, 1990 
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problem difficulty and id. the nature of children's errors (For, ah overview see Carpenter 
& Mosei: 1982, 1984; Riley 1979; Riley &,Greeno 1988; Reusser 1989b). 

So far, less emphasis has been put, however, on oUicr, non-mathematical.task cha- 
racteristics as, e.g., on lingusitic form factors (language knowledge) and on episodic or 
situational factors (world knowledge) which constitute the presentational structure 
(Clark 1983), or the overall verbal setting of mathematical word problems. 

The following set of problem statements which mirror th^ same- change problem^ 
type (change-4) with a given start sef and a given result^setand an unknown tranfer-out 
set, only represents a small subset of almost numerous possible verbal formulations of 
the same episodic problem situaricn (some of the linguistic- form' variations are put in 
parenthesis; every problem can be stated with or without a pfoblem question). 

* (First) Alice had 9 cookies.. jCThen) She (Alice) gave some cookies to Peter. Now 
she (Alice) has 4 cookies. How many cookies did she give-tp Peter? 

* Alice had 9 cookies. She .gave some away. Now she has 4. How many cookies did 
Alice give away? 

* Alice had 9 cookies. Now she has only 4. - 

* Alice got 9 cookies from Bruce. She gave some of them to Peter. Now Alice still 
has 4 vcookies left. How many coolqes d\d Peter get (from Alice)? , 

* Recently Bruce gave 9 cookies to Alice. Shortly aftqr that, Alic^ had (only) four 
cookies left. She gave some cookie§.to Peter, How many fewer cookies does Alice 
have now than she got from Bruce (than she had first)? 

* Recently Bruce gave .9 cookies to Alice. S'hordy after that, Alice had (only) four 
cookies left She gave some cookies to Bemadette, How many more cookies did 

Alice have first than she has now? a 

'it' 

* Peter got some cookies from Alice. Now Alice has (only) four cookies left. First 
Bruce gave 9 cookies to Alice. How many cookies did Alice,give to Peter? 

* Alice has a sweet tooth. From the 9 cookies she.got from Bruce, she has only 4 left. 

* Alice has 4 cookies. (Before) She had 9. Hovy many cookies did she give to her 
friend Meter? 

* Peter likes cookies a lot Sometimes he gets cookies from Alice. Today Alice got 9 
cookies from Bruce. Then she met Peter. Now she has (only) 4 (left). 
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* After giving some cookies to Peter, Alice counts four cookies in her bag. l^ruce. 
gave her 9 cookies this moming. It we know that Alice did not eat a single cookie 
yet, how many cookies did Peter get? 

The problem formulations differ in many subtle ways, mainly in the explicitness 
of the mathematical problem structure stated, in the presence and quality of the pro- 
blem question, in quality and degree of elaboration, coherence, completness, of the 
situation description, in the kinds of presuppositions that are ' made by the verbal 
setting, and in the sequential order of mention of the situation elements. ^ 

There is evidence that task variables Jbeside the conceptual structure can have a 
significant influence on problem difficult>v In a study from Hudson (1983) dramatical 
changes in performance were found if the identical problem situation "there are five 
birds and three worms" was presented to children of different age levels \vith either of 
two questions: 

, (a) How many more birds are there than worms? 
(b) How many birds w^on't get a worni? 

Correct performance with question (a) ranged from 17% to 64%, with question (b) 
from 83% to 100%. While with the unfamiliar question (a) the correct parsing of the 
complex linguistic form "have-tnore-than" is required, the more familiar question (b) 
allpws to simulate a real world one-to-one correspondence of hungry birds that eat. the. 
^ worms, or want to eat. them, respectively. This important obsen'ation suggests that 
word arithmetic problem solving is not just aimatter of the^right arithmetic strategies 
being cued by the right linguistic expressions, but that an understanding of the situation 
as a whole :an constrain and facilitate the problem solving (Reusser 1985)^ 

Results pointifig into a similar direction were found in a study by De Corte, Ver- 
schaffeL and De Win (1985). The authors manipulated the degree of explicitness in 
which the semantic relations between the quantities in a problem were stated. They 
found, that rewording problems in such a way as to more explicitly oj unambigupusly 
statiijg set relations facilitated correct solution of young elementary school children. 

These results, among other effects of linguistic and situational factors (Reusser & 
St^b 1989; c.f also the studies from Hayes & Simon 1977; Nesher & Katriel 1977) on 
word problem difficulty, suggest that one should become more aware of -wording or 
framing a particular logico-mathematical structure. 

The. neglect of linguistic and situational factors in mathematical word problems is 
both true for a large body of current theorizing and the majority^of existing empirical 
work. Numerous experimental studies have .been conducted using the same linauisti- 



cally and semantically impoverished setof problems (which contain litile verbal infor- 
mation beyond what is directly relevant to the arithmetic) and existing psychological 
process models are - if not lacking any assumptions at all - apparently A^eak in their 
text and situation comprehension apparatus. Eitherj as in the model of ^Riley ,et .al., 
language comprehension is completely bypassed, or, as in the model of Briars & 
Larkin, text prck:essing assumptions arc specifically tailered to the eniployed^probl^ 
set. , , ^ 

Only the Kintsch & Greeno model (1985) which is based on the strategic dieory 
of discourse comprehension developed by Van Dijk & Kintsch (1983), includes a 
worked out text comptehension component EoUowihg this approach and complenien- 
taiy to a purely Jogico-mathematical explana-ti,on of prqblem solving difficulties of 
young.children, Cuniriuns-Dellarosa, Kintsch, Reusser & Weimer*(1988) have ^t7or- 
ward (and partly tested) the hypothesis thatmuch of the difficulty children experifence 
with certain word problen^s can be attribpjed to a difficulty'in comprehending complex- 
or ambiguous Janguage. Moreoyej^iiv'her implementatipn of the Kintsch & Greene 
model, Dellarosa (198i5rsee ^(Iso'Kintsch l987), was able.to.siitiulate errors which were 
due to; linguistic (lexical) misunderstandings, as e.gTto the faulty parsing of antiimetic 
kpy words like "some", "altogether", or "have-more-than". 

Altliough the Kintsch & Greeno model and its implementation by Dellarpsa 
(1986) is well-suited to explore certain types of lingistically based,errors, there arc also 
limitations of this approach; mairlj^ related to the weak and lacking language- and 
knowledge-based reasoning capabilities of the model. Basically, Kintsch & Greeno 
follow a one-^step approach of mathematization by jumping (via some arithmetic strate- 
gies) directly fit)m the prepositional text base to a mathematical problem model. As in 
the other simuJation models mentioned above, no^ attempt is made .in this model to. 
understand th§ situation described by a word problem. This.drect translation from text 
propositions to equations (see also Bcbrow 1964), wher^r a word "problem^ is only 
understood in terms of its aridimetic structure on the basis of a^ few key words (see 
Nesher &,Teubal 1975), may be a good idea for experts in the^'pr^blem domain, .as e.g. 
for older children who know very well the problem types with their associated madie- 
matical reasoning strategies. It is probably not a good idea for die modeUing of the 
behaviour of vcty young children, who neither possess. spezialized arithiTietic strategies 
nor powerful verbal and world-knowledge based reasoning strategies yet, to skip the 
representation of the non-arithmetic situation. 

This leads to our own theorizing about the role that linguistically induced under- 
standing.df the situation (states, events, actions) plays in solving word problems. (Wha! 
is the nature a of ^ "model" that is constructed from a word problem and that underiies 



solution?) What are the determinants x)f its construction? In sum: What are the features 
of a model that constructs a. problem representation base^ on sttategies Uiat take into 
account the specificlituafional structure-as well as its wording. 

Guided by the epistemological intuition that early rhathematical learning is 
embedded in everyday acting and reasoning (Piaget 1950; Aebli 1980), and that ma- 
thematical operations are the developnriental derivatives of concrete, sensorimotor 
acting anjd manipulating, a process model was developedjn- which ihe construction of 
an episodic, i.e. non-matlien;iatical situation model is3 the ^pore level of representation 
as, a mediating level of understanding, situated between the proposnional text base and 
the arithmetic^ problem model. / 

From text tO situation to equation: a process model 

In our process model SPS (Situation-Problem-Solver) of understanding and sol- 
ving word, arithemtic problems^(Reusser 1989a,b) we have combined elements ot the 
model of children^s.arithmetic problem solving by Kintsch & Greeno (1985) v/ith ideas 
about the strategic nature -of mathematization as a process of elaborative and goal- 
directed text comprehension and. situation comprehension and about the. teaching of 
that process. For a large class pf word-problems this means to transform (translate) a 
natural language text with its characteristicJuzziness, intathe canonical representation 
of a formal equation. The theoretical -issues that motivates our research concerns the 
nature of the "model" that is constructed fromi word problem ^ . 

SPS lake^.as input elem^entaiy addition and subtraction vt^prd problenis, "understands" 
and solves them-by means of-varioiis types of lexical, syntactic,, semantic and pragma- 
tic strategies, and finally, gives back a numerical an^wei; embedded in^an answer sen- 
tence that takes account of the^problem situation. .SPS is using^ several levels of com- 
prehension, i.e. consists of a progressively deepening of the understanding of a problem 
text.,Xhis is reflected in the model by the construction of a muUilayered problem repre- 
sentation achieved by a hierart lical structure pf macrostrategies (Figure 1). A first 
macroStrategy guides the construction of a propositional structure of case frames (text 
base sensu Kintsch 1974) by using,a set of lexically based propositional 

meaning postulates., A.second.macrostrategy - refering to the essential pan of situation 
comprehension in SPS - creates a mental model of the z^cnon or situation structure as a 
whole (the episodic problem model). After the situation model has been built, a third 



3 From an educational or instructional point of view: it should be. 
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macrostrategy, which is mathematically oriented, reduces the »episodiCi||oblein r^pre-. 
sentation t o its abstract mathematical gis t (called the mathem atical problffl mod el) by 

^ -_ <- * 

mapping the semantic .relations between the states aiVd actions in the situai^n model 
onto an abstract structure of set relations 4 After the arithmetic problem model is ab- 
stracted ;from the situation, a forth macrostrategy extracts^ the numeric structure or^ 
equation and solves it by means of various subr.tratcgies. P^^^y* a fifth macrostrategy 
generates an answer sentence-which refers back to the question or the gap in the situa- 
tion model and gives meaning to the numeric answer. * 

SPS is implemented as a production system in Interlisp-D 5 It currently solves an 
open class of about sixty word problems, most of i\\zm belonging to the overall type of 
change proh\tmsfi S?S tolerates a great deal of variability in prbblerctwording, and is 
capable of doing a lot of world knowledge inferencing, mainly associated with the 
molecular analysis of time and function in the action episodes. Because of its molecular 
design, SPS can simulate for everj' word problem several (up to twelve!) comprehen- 
sion paths i.e* sequences of language and world knowledge based (micro-) inferential 
steps. 

Em pirical work 

Word problems provide a valid discourse entity and an interesting case in text 
comprehension, because the goaj of comj)rchen$ion is clearly, defined. Moreover there 
exist objective measures as to whether or not, that goal was achieved. 

However, it should be noted, that empirical testing of a^cognitive simulation mo- 
del is not a trivial task (see Qhlsson 19.88). There is no clear-cut methcdology so far as 
how to test complex cognitive simulation models. 

The basic psychological and instructional hypotheses associated with the idea of 
an intervening episodic situation model in SPS states that, for most problem solvers,- 
linguistically cued situational understanding is not (and in an instructional context: 
should not be) a superfluous, but a necessarj' and helpful achievement (see e.g. 



4 Wiih Aebli (1980) we see operations as abstract actions: Concrete actions as , e.g., lo give, gci, or lose, 
bear an abstract relational ideas whioh can be expressed by ihc abstract meaning of mathematical opera- 
tions as, e.g., adding or subtracting 

5 The computer program runs on every XEROX AI worksta'tion, 

6 In change problems, an initial state undcrgocs a jansfer-in or transfer-out of items, and the cardinality 
of either the initial set, the t/i:nsfer set oder the resulting set must be computed. 
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Hudson*s data).. The tlieoretical and empirical issue is that the logico-mathematical 
structure of a word problem is merely one constraining factor of getting at the right 
arithmetic strategies. Other important, andprobably underestimated factors which con- 
su^n and therby facilitate problem understanding and solving, ar^ the -situation as a 
more or less familiar and vivid episodic event-structure and its wording. 

In a series of empirical studies? we have manipulated (beside, ^variations of the 
problem type) various factors of the textual and presentational structure of word pro- 
blems as e.g. the order o? mention :pf the elements in a problem statement, the degree of 
textual elaboration and connectivity, the presence or absence of a problem question, 
and the naijative focus of the story pro"tagonist."^Results, as. available so far, give 
suppon to the hypothesis that more elaborated or more explicit problem texts (with 
respect to set relations and to mathematical actions) facilitate problem solving - as wc^ 
think, by leading to the construction of mgre appropriate- mental situation models. In 
the following sections, I repon one of our, experiments^ 

<« 

Experimentr-Nairative focus and familiarity of script in understanding and solving ^ 

word problems. 

In the experiment to be described here, we were looking at the role of two linguistic, 
and of one situational factor on comprehension difficulty of simple mathematical word 
problems. The linguistic form factors that were manipulated concerned the narrative 
focus of the problem episode and the problem question. That is, we were looking at 
actor-perspective, from which a story problem was nai rated. While these factors can be 
manipulated without changing iht problem situation, a script factor that varied, the re- 
lationship of the oo-actors in the^story (familiar versus unfamiliar relation of cpactors), 
changed* the situational structure of the story; " 

Because it is our main interest to study text and situation comprehension difficulty 
rather.than arithmetic skills and in order to minimize the undesired consequences of 
kinds of a speed-accuracy tradwff, which we certainly had to expect if working with 
reaction times of unexperienced very young children, only adults (university students) 
participated in the experiment.8 



7 English versions of ihc papers arc in preparation (Reusscr & Siaub; Reusscr 1989c; sec also Cummins 
etal. 1988). 

8 The expecjaiion was thai adults would produce ceiling elfccts regarding frequency of correct soluUons, 
but a reasonable variance regarding solution time. 




Wc predicied that solution performance would van' v.ath boih factork First, pro- 
blems^with the narrative focus consistent with the focus of the main actor or protago- 
nist of the stor>' jhould be easier than problems with Inconsistent (i.e. changing) narra- 
tive focus. Second, problems with coactors. interrelated in familiar ways (as, e.g., 
faiher-/mother-son-relaiionship) should be cf^ier than pro^lem^ wiih completely unre- 
lated coactors. The first prediction can be derived from our explicit simulation model 
(and various comprehension errors therefore can be simulated by SPS). The second 
prediction, while being consistent with Mt iheorerical assumptions of .SPS and only 
matches the more general spirit of situation comprehension of ihc model. 

Method 

Apparatus and materials. The 32 story problems from Table 1 served as stimulus mate- 
rial. Basically, all problems consist of variations of four instances of Change problems 
(Change 3 to Change 6; see Riicv "ti al. 1983), in which a starting set undergoes a trans- 
fer-in or transfer-out of items, and the cardinality of the stan st i or initial state, or of 
the transfer set must be computed given infonnarion about two of the three relevanr 
sets. In order to make the individual problems more distinct from each other, the pro- 
blem tj^pes (as defined by the direction of transfer and the location of the unknown 
quantiiaty) are systematically confounded with the order of mention or textual order of 
the situational elements (initial state or action, transfer action, resulting state). All 
change 3 problems are associated with the textual order 2-3-1 9, all change 4 problems 
with the order of mention 3-2-1, change 5 problems with 2-3-1, and change 6 problems 
with 3-1-2.- . . 

All problems used in the present snidy consisted of two actions (an action genera- 
ting the initial state or die start set, arida transfer-iii/out action) and the resulting state. 
All problems therefore contained three coactors, one of them "erving as the protago- 
nist, or the main character of the story. The protagonist of a story is the matheniatically 
relevant actor, who panicipates in every panial action or state of the story as the person 
who gets, receives, or simply posesses a cenain amount of Items (while the two subor- 
dinate coactors only participate in one panial action of the stor>'> For example, in the 
problem 

Today Silvia got seven marbles from Urs. Yesterday Hans gave some mar- 
bles to Silvia at ihe playground. Now Silvia has fifteen marbles. How many 
marbles did Silvia get at the playground? 



9 I.e. the U"uisfcr action is mentioned first m ihc problem icxU followed bv the initial state and ihc rcsul- 
ling state. 
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TMt }: Set of 32 problems uscH in tfie experiment (cont) 



Unrelated coactors 

CH3 Today Rucdi got some marbles from Hannah at the playground. Now Ruedi has eleven marbles, 
Yesicrday iRucdi got eight marbles from Daniel. (ENF-P) 

Today Hannah gave some marbles lo Ruedi at ihe^playground. Now Ruedi cscven maAles, 
Ycsie;day Danid gave ejghi mcrbles »o Riiedi. (ENF-CA) 

— ^ ^ 

* How many m^lts did Ruedi gel ai the playground? (Q:NF-P)'~^ 

How many marbles did Hannah give away ai the playground? (Q:NF-CA) 

CH4 Now Sonja iias nine marbles. Today Sonja ^ve some marbles to Marianne at the playground. 
Yesterday Sonja gbi tvr-elve marbles from Nathalie. (E:NF-P) 

Now Sonja has nivjc marbles. Today Marianne got some marbles from Sonja at the playground. 
Yesterday Nathalie gave twelve marbles to Sonja, (E:NF-CA) 

♦ How many marbles did Sonja give away at the playground? (Q:NF-P) 

♦ How many marbles did Marianne get at the playground? (Q:NF-CA) 

CHS Today Silvia got seven marbles from Urs- Yjesierday Silvia got some marble-^ fro a Hans-at the 
playground. Now Silv;^ has fifteen marbles. 'OB:NF-P) 

Today Urs ^ave seven marbles to Silvia* Yesterday Hans gave some marbles to Silvia at the 
playground. Now Silvia has fifteen marbles. (E:NF-QA) 

* How many marbles did Silvia get at the playground? (Q:NF-P) 

♦ How many marbles did Hans give Away at the playground? (Q:NF-CA) 

.CH6 Now Aiieue has nine marbles. Yesterday Anetie ga some marbles from Werner at ihe play- 
ground. Today Aneue gave three marbles to Reto. (EJSF-?) 

Now Anctte has nsnc marbles. Yesterday Werner gave some marbles to Ancitc at the play- 
ground. Today Reto got three tnarbles from Anettc. (E:NF-CA) 

* How many marbles did Anette get from Werner at the playground? (Q:NF-P) 
^ How many marbles did Werner give to Anet:3 at the playground? (Q:NF-CA) 
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Related coactors 

CHS Today Rucdfi got some marbles from the gransmoihcr at the playground. Now Ruedi lias eleven 
marbles. Yesterday Ruedi got eight marbles from his grandfather. (E:NF-P) 

Today the grandmother gave some marbles lo Ruedi at the playground. NoW Ruedi has eleven 
marbles. Yesterday the grandfather gave eight marbles to Ruedi. (E:NF-CA) 



* How many marbles did Ruedi gei al the playground? (Q:NF-P) 

* How many marbles did the gran:imother give away at the playground? (Q:NF-CA) 

CH4 Now Sonja has nine marbles. Tod^y Sonja gave some marbles, to her best friend at^the play- 
ground. Yesterday Sonja got twelve marbles from her mother. (E:NF-P) . ^ 

Now Sonja has nine marbles. Today her best friend got some marbles from Sonja at the play- 
ground. Yesterday the mother gave twelve marbles to Sonja. (E:NF-CA) 

* How many marbles did-Sonja give away at the playground? (Q J^-P) 

* How many, marbles did ihe^friend jet an the playground? (Q:NF-CA) 

CHS Today Silvia got seven iparbles from the teacher. Yesterday Silvia got some marbles from his 
godfatfier at the playground: Now Silvia hasXjftcen marbles. (E:NF-P) 

Today the teacher gave seven marbles to Silvia. Yesterday the godfather gave sowe ;n jbles tt> 
Silvia at the playgtbund. Now Silvia has fifieen marbles. (E:NF-QA) 

* How many marbles did Silvia get aithe playground? (Q:NF-P) 

* How many marbles did the godfather give away at the playground? (Q:NF-CA) 

CH6 Now Anette has mne marbles.^Yesterday Anette got some marbles from the babysitter at the 
playground. Today Anette have three marbles lo her sister. ^:NF-P) 

Now Anette has nine marbles. Yesterday the babysitter gave some marbles to Aneue at the 
playgrou;.u. Today hcr sister gotlhree marbles from Anette. (E:NF-CA) 

* How many marbles did Anette get from the babysitter at the playground? (Q:NF.P) 
*, How many marbles did the babysitter give to Anette a .ac playground? (Q-NF-CA) 

Table 1 : Set of 32 problems used in the experiment 

The 32 problems can be obtained from the table by combining - for each problem type - four conditions 
of iiarraiive focus (two focus coriditions of story episode by two focus conditions of question) with two 
condiu'ons of coactor-relatipnship or script (Related versus unrelated coactors). 
E: Episode; Q: Quesiion; NF-P: Protagonis-Relaied Nanrative Focus; NF-CA: Coacior-Related NarraUve 
Focus; E:NF-i^: Protagonist-Related Episode; E:NF-CA: Coacior-Relatcd Episode; QrNF-P: Protagonist- 
Related Question; Q:N F-CA: Coactor-Rclated-Question 
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Silvia serves as^the protagonist, because she is the actor who gives rise to a coherent 
xnathematical acnon. While she occurs in every sentence of the verbal statement (cither 
in topic or non-topic position), the coactors Urs and Hans are mentioned in the problem 
only once. .Their contribution to the episode is essential (giver, receiver of iteriis), but 
subordinated to the action episode as a whole. 

Three experimental factors were implemented" in the^present'Studyrtwo^of^them " 
rather linguistic, one rather situational in nature. While thc'^st and the second factors 
are associated with the narrative perspective or point of view from which cither the 
story episode in a problem is presented, or lht final question is posed, the third factor is 
associated with the familiarity of the employed story^ scripts. The following factors ' 
have been systematically varied: - Factor I: We call the narrative focus (NF) of astory 
episode (E) protagonist-related (P) or consistent, if the protagonist in, every partial 
action or state is in topic position, or serves as the grammatical sabject of the rcspcc- 
tives sentences in the verbal problem statement (E:NF-P). The narrative focus of a 
story episode is called coactor-related (CA) or inconsistent, if the Qoactor in sentence 
topic position is not identical with the protagonist, or is changing within the same story 
episode (E:NF-CA). -Factor lb The narrative focus of the final question statement, ((J) 
of a: story problem \% said to be protagonist-related (Q:NF-P) if in^thcljucstion sta- 
tement of the problem the main story character is in topic position. Complementary, the 
narrative focus of the final question is said to be coactor-related (Q:NF-CA), if a sub- 
ordinate coactor of the story is in topic sentence posidon. Factor III (script factor): The 
relations between the coactors in a problem are^aid to be unfamiliar if the coactors are 
represented by three unrelated proper names or individuals, one 'of which serving as 
lEe main character of the story. In contrast, the relations between' the coactors are called 
familiar if only the protagonist of the story is introduced by his/her proper name, and 
the two coactors are introduced by some obvious relationship in which they stay to the 
protagonist (being a relative, a friend, a teacher, or a functionally defined partner in an 
interaction, as e.g., a salesperson in a store). While, in the first case, the three coactors 
are. almost completely unrelated in the text (beside the fact that they ,transfer items bet- 
ween each other), in the second case, the text invites the reader to form a familiar script 
of personal relations between the protagonist and his/her coactors of the story episode. 

In Table 1, the 32 problems are constructed by combining - for each of the; four 
problem types - four conditions of point of view (two levels of episode focus by two 
levels of question focus) with two conditions of coactor-relationship. In order to make 
the individual problems somewhat more distingjishable from each other, some further 
textual variability was introduced across sing?e problems by varying the names of indi- 
viduals, objects, locations, and of temporal specifications. 



Subjects. Seventy-six adult students from different departments (law, medicine, 
sciences, humanities) of the University of Bern voluntarely served as participants in the 
study. ' 

Procedure. The experimental factors were crossed to form a2x 2x2x4 design, 
the two focus factors and the problem type being within-subject factors, the script fac- 
tor (related versus umielated cdabt(5r?) being^ a betweeTi-subjecr factor * Each* subject 
received half of the 32 problems, i.e. 16 problems, one problem from each problem 
type (change 3-6) under four of the experimental condidons. 

Subjects were tested individually in a quietroom in front of a computer screen. 10 
Th© sessions approximate!} -lasted^wenty to thirty^ninutes, and began with verbal iii- 
structions concerning the general apparatus and the problem solving tasks. All detailed 
instructions as well as the problems including four practice problems were presented to 
subjects on the screen of an AT personal computer. During the instructional phase, 
subjects were tought to push the ENTER key as soon as they ^ad solved a problem, 
then to type in the numerical solution in an^blank screen-field, and (if ready to go on)*to 
push the ENTER key again in order to get the next task on the screen. Problem presen- 
tation was rancjpmiz^d for each subjeQt. Numerical solutions as well as solution times 
(the main dependent variable in this study) were recorded by the computer. ; 

I^esults 

Solution accuracy. As expected from our subjects, proportion of correct answers 
were generally high (change 3: 97%; change 4: 95%; change 5: 96%). The highest per- 
centage of incorrect solutions occurred with change 6 . problems (78%). Five subjects 
with more than three wrong numerical solutions were abandoned from fimher analysis 
of solution times. 

Solution time. Solution times produced by subjects as a function of naixative focus of 
bothjspisode and question and of coactor-relationship (script) were computed and are 
presented in Table 2. Following Conover & Iman (1981), a rank nransformation proce- 
dure (replacing original observations with their respective ranks) was applied in order 
to reduce the influence of exp-eme values. An analysis of variance was then conducted 
on these ranks using as between-subject factor coactor-relationship (Unrelated or 
Related), and as within-subject factors narrative focus of both story , 



10 Ruedi Slussi wrote the Pascal programm by which the experimenl was run on the computer. 



Table 2 
Mean solution tiraes ( sec:> 



UCA: Script with Unrelated Coaotora 

E:NF--P: E*l:otagonist-Related Episode 
E:NF^CA: Coactor-Related Episode 

1 ^ ^ 1 

Mean 



Q:NF-P 
Protagonist- 
Related 

Question ^ 



26,02 
31,39 



28,70 



Q:HF-CA 

Cpactor- 

Related 



>32,78 
30,34 

31,56 



Mean 



29,4:0. 
30>86 

30,13^ 



RCA: Script with Related Coactors 

E:NF-P: Protagonist-Related Episode 
E:NF~CA: Coactor-Related Episode 

Meah 



22,06 
23,04 

22,55 



23, or 

24,33 
23,67 



22,54 
23,68 

23,11 



Mean 



25 , 76 



27,78 



26,77 
(Sd: 17,3) 



Note: Cell means are based on an average of 142 observations (4 prctblems from each of 37 (UCA- 
condition) or 34 (RCA-condition) subjects, respectively, under each cell condition) . NF: Narrative 
focus; E: Episode; Q: Question; P: Protagonist; CA: Coacto:-. 



ERIC 



16 



17 



15 



episcxie and question (Consistent or Inconsistent); and. problem type (Change 3 to 
Change 6), with repeated measures on the latter three variables. 

The analysis returned three significant main effects and four interactions. The first 
main effect was of script or coactor-relationship, F(l,69)=10.41, p<.'602, indicating that 
solving problems with script-unrelated cpactors took considerably longer than pro- 
blems with script-related coactors (mean diffS-enw^^ 

main effect of narrative focus of the question, F(l,69)=4.73, p<.04, indicating that un- 
derstanding and solving problems took longer when the quantitative question was for- 
mulated from the unusual point of view of a cpactor. The thir4 was^a main effect of 
problem type, F(3,207)=28.29, p<.(X)0, indicating Change 6 as being the most difficult, 
and Change 3 as the^ easiest of the employed problems."! 1 

While no significant main effect of narrative focus of the story episode w^as ob- 
served, F(i,69)=2.78, p<.10, there was a significant interaction (Figure 2) between epi- 
sode focus and question xbcus, F(l,69)=6.51, p<.02. AlLproblems with either one, or 
both episode and.question focus inconsistent or coactor-related (coactors in sentence 
topic position) were hard to understand, whereas ^the problems consistently xnarrated 
from the point of view of the protagonist topk considerably less time to get at^the solu- 
tion. Narrative i focus of the story episode also interacted with problem type, 
F(3,207)=4,76, p<.005 (Figure 3). This was the only interaction. that was obseived bet- 
ween problem type and experimental variables. ' * 

A significant interaction was also returned from the analysis between ccript versions 
(related versus unrelated coactors) and narrative focus of question, F(l,69)=5.24, p<.03 
(Figure 4), but not between script and narrative focus of story episode, where the analy- 
sis of variance yielded an F, close to zero for the interaction. These results indicated a 
triple interaction between script, story episode and question focus. Although this 
interaction was not statistically significant, F(l,69)=3.05, p<.D8, there both was a sta- 
tisticfil tendency and a clear pattern of results observable as it is shown, in Figure 5-1 
and 5-2. Under the condition, of related coactors, comprehension difficulty (which was 
generally rather low) was only marginally modified by the point of view of naixation 
(Fig. 5-2). However, under the condition of unrelated coactors (Fig. 5-1), not only pro- 
blem difficulty was generally much higher, but there was also, an interaction between 
focus of story episode and focus of question. According to this interaction, problems 
with both protagonist-related episode and protagonist-related question were the easiest, 
but were still more difficult than all cases in the, condition of script -related 



11 Because problem type and text order (order of mention) were confounded in this experiment, it is 
hard to speculate about the reasons of exactly this profile of problem difficulties. 
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Interaction between script (related vs unrelated coactors) and question focus. 



coactors. Under all conditions of inconsistent focus, difficulty of comprehension, as 
measured 'by solution times, was considerably increased. 

Discussion 

The results of this experiment indicate the script factor (related versus unrelated 
coactors) to be a dominant source of comprehension difficulty*. Problems with unrela- 
ted coactors were generally much harder to understand than problems, with related 
coactors. Moreover, if the three coactors in the story script were related in, faniiliar 
v^ays, narrative focus transformadons hardly had an influence on problem difficulty. 
Not so in the case of completely unrelated coactors in the story scripts, where problem 
difficulty varied with the transformation of narrative focus. 
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A reasonable and theoretically consistent interpretation of this pattern of results 
(with respect to SPS) goes with the assumption that coactors relating to each other in 
fsuniliar ways, are more easily contributing to the forming of a more familiar' and more 
coherent .story script than do coactors which are not related at all - and therefore are 
beneficial to the construction of a situation model. Subjects who are able to benefit 
.fronLmore..coherent,. more, interrelated scrip.ts,.are.able to_ci^^^^ 
with possibly less effort on the analysis of the- (changing) narrative focus. The possible 
-reason might be that in the story script related coactors, that are more distinct from 
each other than proper names, serve as powerful cues for the necessary topic identifica- 
tion strategies (or in terms of SPSrfor protagonist or main character identifitation 
strategies) on the level of situation comprehension.. In the cohdition of related actors, 
only the mathematical protagonist is introduced' b; its pnJper name, i.e., as a distinct, 
independent individuum. The two, other coactors have no proper name in the problem 
statement. They are introduced by relational generic terms, as e.g. grandmother, father, 
godfather, teacher, etc. In the text world of the problem, they only exist in their relation 
to the (sanie)jnain^char^^ it easy to identify the character, vho is intro- 

duced in the story episode by his proper name, as the mathematically relevant charac- 
ter^-or protagonist, independent of his topic or non-topic position in a single sentence. 
To identify the protagonist in the stories with related coactors^ simply means to pifck the 
participant who is introduced by his proper name as the protagonist^ and to reconstruct 
the story from.his perspective. This can, not be done "one-line^i.e. while, ^hile reading 
the problen) text the first time) if three unrelated, completely distinct coactors are, 
introduced. In this case, comprehension difficulty depends on the narrative focus in 
such a way that all problems versions containing a shift of narrative focus, were mpre 
difficult to comprehend in the experiment. 

Why are word problems difficult? The present results support the usefulness of 
the theoretical perspective discussed in the introductory part of this paper. The results 
reported;here suggest that, beside mathematical structure variables (as problem type or 
the location of the unknown quantity) and arithmetic skills, text comprehension or lin- 
guistically based factors and - mediated by these - situation comprehension factors 
figure heavily in word problem difficulty. In terms of our theoretical model SPS 12: If 
narrative or discourse comprehension involves at least tv/o related major components, 
first the translation of the surface form of a text into a text base, and second the pon- 
struction of a mental model of the* situation described by the text, then it is reasonable 
to assume that the more explicit the text base, that is cued by the explicit linguistic 



12 And in accordance with the findings of the study of De Cone, Verschaffel & Dc Win (1985) on ihe 
innuencc of linguistic factors 



20 



features of the problem siaiemejii, is, the more easy the construction of the siiuLtion 
model will be;. 
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